Quantum Dynamical Entropies 
for Classical Stochastic Systems 



Mark Fannes and Bart Haegeman f] 

Instituut voor Theoretische Fysica 
CSJ ■ K.U. Leuven, B-3001 Leuven, Belgium 

O ' 

o 

£ 

q \ Abstract 

<N . 

We compare two proposals for the dynamical entropy of quantum determinis- 
. tic systems (CNT and AFL) by studying their extensions to classical stochastic 

systems. We show that the natural measurement procedure leads to a simple ex- 
plicit expression for the stochastic dynamical entropy with a clear information- 
theoretical interpretation. Finally we compare our construction with other 
recent proposals. 
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^ 1 Motivation 
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Dynamical entropy is a standard tool for the study of classical deterministic systems, 
see, e.g., [ |Wal | . It measures the marginal amount of uncertainty generated by the 



dynamics, or, equivalently, the marginal amount of information obtained about the 
initial condition. Different approaches have been followed to generalize the idea of dy- 
namical entropy to quantum systems, | |AliFanl| , |AliFan2| , [Acc et al"| , |Con et aEj , |Hud| . 



Thereby, one encounters, apart from the non-commutativity, still another problem : 
Not only the dynamics can generate uncertainty, but also the quantum measurements 
can do so. A good calculation scheme should separate these two contributions. 

The latter problem is also present when extending the notion of dynamical entropy to 
classical stochastic systems. In this case, the different sources of entropy production 
to separate are the system dynamics and the stochasticity due to the coupling to the 
unobserved environment. Therefore, from the dynamical entropy point of view, clas- 
sical stochastic dynamics can be considered as an intermediate case between classical 
deterministic and quantum dynamics, [MaH . 



We will make this link even more explicit by taking two established quantum con- 
structions (CNT [|Con et al.f and AFL ||AliFanl| , |AliFan2|| ) as a starting point and 



extending them to stochastic systems. As a consequence, next to system and environ- 
ment, so-called unsharp measurements appear as a third source of dynamical entropy. 



1 Aspirant FWO-Vlaanderen 
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Interestingly, the different quantum constructions lead to clear-cut differences which 
we can interpret in terms of these three sources. E.g., for the extreme situation of a 
Bernoulli process, where the stationary completely random state is already reached 
after a single time step, successive observations of the system do not reveal any in- 
formation at all on the initial state of our system. The degree of stochasticity of the 
dynamics can be measured however and, moreover, very unsharp observations of such 
a process will overestimate this randomness. 

Quantum dynamical entropy has recently received new interest in connection with 
quantum information theory. Both dynamical entropies we will discuss in this paper 
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have been reformulated in this framework, CNT in 
stochasticity we introduce can both model badly isolated information sources or noisy 
communication channels. Finally, this work can also be considered as a first step 
in the construction of a dynamical entropy for quantum stochastic systems, as was 
recently done in [|Kos et al.| . 



2 Preliminaries 



Deterministic classic dynamics are given by a transformation T of the phase space X. 
For stochastic systems one should use stochastic transformations of phase space. It 
is more convenient to work on the level of the observables, i.e., the functions on the 
phase space. Such a description allows also to connect with the quantum world by 
allowing the algebra of observables to become non-commutative. The dynamics is now 
given by a transformation B of a function space on the phase space X. The different 
concepts needed to introduce dynamical entropy, like partitions, their evolutions and 
refinements, must be transported from the level of the points of phase space to the 
level of observables. 

2.1 Some notation 

Let /j be a probability measure on the set X. Consider a transformation G of the 
algebra of observables, G : L°°(X,fi) — > L°°(X,fi), which is 

• positive, / > =>• G(f) > 0, for all / G L°°(X,fj), 

• unital, G(l) = 1 and 

• measure-preserving, /i(Q(/)) = for all / G L°°(X, /i). 

The triple (X, 6) defines a stochastic dynamical system in discrete time. 

Example 2.1 (Markov process) Let X be a finite set and fi = {fi x \ x G X} a 
probability measure on X . Let P be a transition matrix satisfying 

Pxy ^ 0, 2_j = 1 aI1C ^ ^^^xPxy = f^y 

y x 
2 



The time evolution &, given by 



e(f)(x) :=E p xy/(y), 



y 



defines a stochastic dynamical system. This finite- dimensional example can be gener- 
alized considerably. Let (X, S, fi) be a a -finite probability space. Let P be a measurable 
function on the product space X x X satisfying 



Example 2.2 (Deterministic systems) Also deterministic dynamical systems are 
included in this formalism. They are given by a probability space (X, S, fi) and a 
transformation T : X — > X which is measure-preserving , fj J (T^ 1 (S)) = (J,(S), S G S. 
Take then 9(f) := foT. 

The positivity of 6 can be rephrased as |6(/)| < 0(|/|) (triangle inequality) or as 
I ©(/)! 2 < ©(I/ 1 2 ) (Schwarz inequality). Deterministic systems are then distinguished 
by the additional property |6(/)| = 0(1/1) or by |0(/)| 2 = 0(|/| 2 ). This means 
exactly that 6 is an endomorphism of L°°(X,fi). 

We are ready now to construct a partition on the level of the observables. A set of 
measurable functions T = {fk \ k G K} with K a finite index set, is called a partition 
of unity whenever fk > and J2k fk = 1- Such a set of functions can be interpreted 
as a response function for an unsharp measurement. The number fk(x) equals the 
probability for the measurement outcome k G K given the system is located in x G X. 

Example 2.3 (Sharp measurements) An important class of partitions of unity 
are those corresponding to sharp measurements. Let C = {Ck \ k G K} be a measurable 
partition of X , i.e., Ck C X is measurable, CkHCi = CkSki and UfcCfe = X . The set 



where xc denotes the characteristic function of the set C C X , is a partition of unity. 

Because deterministic dynamics act on the level of points of phase space, sharp mea- 
surements suffice in this case. Stochastic dynamics, on the contrary, smooth out sharp 
measurements. It is then natural to consider unsharp measurements. This implies, 
however, that a measurement as such, i.e., independent of the dynamics, can con- 
tribute to the dynamical entropy. Compared to classical deterministic systems, this is 
a new phenomenon one should take care off when constructing a dynamical entropy. 




and 




The time evolution 6 is given by 



8(/)(x):= fdii(y)P(x,y)f{y) 



Xc ■= {Xc k I k G K}, 
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2.2 Refined partitions of unity 



For two partitions of unity, T = {fk \ k E K} and G = {gi\l E L}, let T V Q denote 
the partition of unity {fk9i \ k E K, I E L}. Also, define the time evolution of a 
partition of unity J 7 , O(^) = {©(/&) | k E K}, which is again a partition of unity. 

The repeated application of the time evolution can be described as a refinement 
of an initial partition of unity. For deterministic dynamics, for example, the refined 
partition of unity after n time steps is given by 

fve(f)v...ve n - 1 (j). (i) 

This can be used as a definition for the evolution of a partition of unity under stochas- 
tic dynamics, |[Mak |. In this paper, we will use another definition, 



jrW[e] ;= jr V 0(jr v ... ve(JF)), (2) 

where the initial partition of unity T appears n times. As is generally only positive 
and not necessarily an endomorphism, the definitions ([I]) and (0) coincide for deter- 
ministic systems, but differ for stochastic systems. This difference can be illustrated 
for a Markov process, Example 



Example 2.4 (Markov process) Let X be the finite state space and T = {fk} a 
partition of unity. The element (ho, hi, ... , k^-i) of the refined partition of unity (^) 
is given by 

X ^ X fko^PxxJk.ix^P^ . . . Px N _ 2 x N _Jk N _ 1 { X N-l), 

(sco,a;i,...,x^_i) 

and equals the probability for the measurement outcome (ko, k\, . . . , fc^-i) given the 
initial state x E X . A similar interpretation is missing for the refinement ([Jj, 

x X! /*o ( X ) Pxxjk, (Xi) P£)jk 2 fa) ■ ■ ■ P^-lhrr-i ( X N-l), 

(x ,x 1 ,...,x N _ 1 ) 

where P^ is the n-th matrix power of P. 



In quantum systems, partitions are replaced by so-called operational partitions, i.e., 
sets of observables X = {xk \ k E K} such that J2k x \ x k = 1- For two such partitions, 
X = {xk | k E K} and y = {yi \l E L}, we can again define Xyy = {x^yi | k E K, I E 
L} and Q{X) = {©(s^) | k E K}. For endomorphisms the refinement of X can then 
be defined as in Eq. (|l]) or, equivalently, Eq. (|^). However, for non-endomorphic maps 
this approach does not work because Q(X) will not be an operational partition 
anymore. Instead, at time n the ^(K) operators x* k Xk should be replaced by 

x k ®( x ki ■ ■ ■ Q^fcn-i^n-i) • • • ^fclj^fco) 

which are j^(K) n positive operators summing up to 1. This is a generalization of (|2|) 
rather than of ([!]). 
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2.3 Entropy and all that 



In this subsection we collect for finite systems the definitions and properties of entropy 



and of relative entropy which will be needed later |[Weh| , |OhyPet|| . These properties 
naturally extend to infinite systems. 

With r] : [0, 1] — > R the entropy function, 

rj(x) := — xlogx, x E (0,1] 
:= 0, x = 0, 

we have the following definitions. 

Definition 2.5 The entropy (or Shannon entropy) of a probability measure p = 
{pi | i E /} with finite index set I , is given by, 

■= ^v(Vi)- 

The quantum entropy (or von Neumann entropy) of a density matrix p on a finite- 
dimensional Hilbert space is given by, 

S g (p) := Tvr](p). 

If we denote by diag(p) the probability measure obtained by restricting the density 
matrix p to its diagonal in a given basis, then S q (p) < 5(diag(p)). Because the entropy 
function rj is concave, the entropies S and S q are also concave. Moreover, one has, 



Proposition 2.6 (Concavity of entropy) Let p, p a , a 6 A and < oo, be 

probability measures on a finite set I and let X = {X a \ a G A} be a probability measure 
such that 

then 

KS(p a ) < S(p) <Y KS(pa) + -S'(A). 

a a 

Similarly, for a convex combination of density matrices p a on a finite- dimensional 
Hilbert space, 

P = YKp a , 

a 

it holds that 

E ^S q ( Pa ) < S q (p) < E X a S q ( Pa ) + S(X). (3) 
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Definition 2.7 Let p and v be two probability measures on the set I, < oo. 

The relative entropy of p with respect to v is 

S (P> I v) := ^/Xilog— . 

iei Vi 

Let pi and p 2 density matrices on a finite-dimensional Hilbert space. The quantum 
relative entropy of p\ with respect to p2 is 

S q (pi | P2) ■= Trpi(logpi - logp 2 ). 

These relative entropies decrease monotonically under positive transformations. 

Proposition 2.8 (Monotonicity of relative entropy) Let M : C(J) — > C(I) be a 
linear positive unital map between the continuous functions on two finite sets I and 
J. This means, for f G C(J), i E I 

M{f)(i) = Y.M l3 f( 3 ) with My>0, £M^. = 1. 

The dual of M maps probability measures on I to probability measures on J. For two 
probability measures p and v on I, the relative entropy S satisfies, 

S(M*p\M*u) < S(ji\u). 

For the quantum case, let M : B — ► A be a linear completely positive unital map 
between two finite- dimensional matrix algebras. The dual of M maps states on A to 
states on B. For two density matrices p\ and pi on A, the relative entropy S q satisfies, 

S q (M*p 1 \M*p 2 )<S q (p 1 \p 2 ). 



As a consequence of this proposition, we have the following lemma. 



Lemma 2.9 Let p, p a , a G A and 

dimensional Hilbert space and let A = 
that 

P = 

then, 



if (A) < oo, be density matrices on a finite- 
= {X a | a G A} be a probability measure such 

ag(Pa)) < Sq(p) - X aS q (p a ). 

a 



Proof Suppose p, p a G Mk and a G A. Consider M : Mk — > M-k ® C{A) defined 
by M(A) = A ® 1. This is a completely positive unital map. Then M* is the partial 
trace of Mk <8> C(A) to Mk- Define, 

Pi = ^Pa ® S a and p2 = J2 A a diag(p Q ) ® 6 a . 

a a 

Applying the monotonicity of the quantum relative entropy, Prop. [2.8| , we obtain the 
inequality we are looking for. qed 
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2.4 Deterministic dynamical systems 



The Kolmogorov- Sinai construction for the dynamical entropy of deterministic sys- 
tems, see, e.g., |[Wal|| , can be cast into this algebraic framework. With the notation of 
Example |2.2| , let v be a probability measure on X and T = {fk \ k G K} a partition 
of unity in L°°(X, fi). Define a probability measure on K by v o T = {v{fk) \ k G K}. 
The metric or Kolmogorov-Sinai entropy h KS [n,Q] for the deterministic dynamics 
with respect to the invariant measure fi can be written as, 



sup lim 

c N^ot 



(N) 

°Xc 



[©]). 



(4) 



where the supremum is over all partitions C of the phase space X, Example |2.3|. 



3 CNT dynamical entropy 

In the following two sections, we will generalize the dynamical entropy (^) for deter- 
ministic systems to stochastic systems. Our approach will be as follows. Different 
quantum dynamical entropies have been proposed in the literature and they all have 
to handle, albeit implicitly, the uncertainty generated by a quantum measurement. 
As explained before, a similar problem arises in the construction of a dynamical en- 
tropy for classical stochastic systems. We want now to reuse the different quantum 
solutions to treat the measurement uncertainty in this classical stochastic context. 

We start by examining the quantum dynamical entropy proposed by Connes, Narn- 
hofer and Thirring in | |Uon et aX ]. In our language the basic notion is the entropy 



of a partition of unity with respect to a decomposition of the invariant measure. In 
particular, let fi = J2 a ^a^a be a decomposition of the invariant measure fi as a convex 
combination of probability measures fi a , a G A and < oo, with coefficients X a , 

X a > and J2 a — 1- Let T = {fk} be a partition of unity. We define 

/[/i, {\ a n a }, T\ := ^ j \ (x S{[i cl oT\[ioT) = S(fioF) -^A a S , ( / u a oJF). (5) 

a a 

To interpret this quantity, note first that a decomposition of fi corresponds to a parti- 
tion of unity Q = {g a } where \ a = /i(g a ) and //«(/) = ^{g a f)/^{g a ) for / G L°°(X, /i). 
In other words, the function g a G L l {X, /i) is the Radon-Nikodym derivative of /x Q 
with respect to fi. Now Q can be seen as a finite model of X, whereas T corresponds 
as usual to a measurement. Define the joint probability distribution \j}£ k := fi(g a fk) 
with marginals /i^ = /i| = ^(fk)- With these definitions, 

/[/x, {A qMq }, T\ = Sifi 1 ) + S(v 2 ) - S(/i 12 ) (6) 

is the mutual information of the two marginals, or the average amount of information 
obtained about an initial condition g a G Q by performing a measurement fk G T . 
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3.1 CNT construction 



The entropic quantity (BJ) is now used in the definition of the CNT dynamical entropy 
of a stochastic dynamical system. Multi-index decompositions of the measure /i will 
be needed, which we write as 

— E Aq/Xq, 

q" 

where a = (ai, «2, • • • , &n), ot n G A n and jf(A n ) < oo, /i^ are probability measures 
on X and A„ are the weights. For every n = 1,2, . . . , N, the marginal of this de- 
composition over all but the n-th index will be written as /i = Y,a n A£*Va ■ More 
explicitly, 



A/? n) - E ^« an d — — j^y E Aa/i„. 

A/ 



a:a n =/3 A ^ a:a n =f3 

The probability measures {A„ | a n G v4 n , Vn} and {A^ | a n G A n } will be denoted by 
A and A*™* 1 respectively. 

Definition 3.1 Let (X, /i, G) 6e a stochastic dynamical system. Define, 
H T [/ i ) -^2, • • • , ^iv}] 

= sup fE^{A£VS},^]-fE^(A (n) )-5(A))Y (7) 

ti=J^-\-fi- \ n=l \n=l / / 



where the supremum is over all finite N -index decompositions. The CNT dynamical 
entropy of (X, /x, 0) is given by 

h CKT [pL, 9] = sup lim ^^ CNT [/i, {F, 6(^), . . . , G^ 1 ^)}]. (8) 

Especially in the quantum case, the optimization problem in ([j]) is the basic obstacle 
for calculating this dynamical entropy, see [Ben], |Ben et aTJ, |Uhl|| . We will analyze the 



supremum for N — 1 and N = 2. 

One-time decompositions For the case N = 1, Eq. (0) becomes, 
H CNT [fi, T] = sup I[fi, {A Q/ u Q }, J 7 ] 

= S{ijloF)- inf E ^aS(fX a o J"). 

The infimum in the second term of the right hand side is a convex optimization 
problem : find the infimum of the concave entropy functional over the convex domain 
of finite decompositions of the measure /i. This infimum will then be reached on the 
set of extremal points of this domain. 

Assume that the partition of unity T = {f^ | k G K} consists of simple functions. The 
result for general fk will follow by continuity. For such simple functions their exists 
a partition C = {Ci | i G /} of X, #(/) < oo, such that fk = J2i fikXCi- The measures 
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fj,, \i a can then be considered as measures on the finite set I, // = {//(Cj) | i G J} and 

A^a = {A*a(Ci) | i G /}. 

Let us now determine the extremal finite decompositions of the measure /i, or, equiv- 
alently, the extremal probability measures on / x A with #(A) < oo such that the 
marginal over the a-index equals \x. We claim that these extremal measures are [if, 
characterized by a map / : I — > A such that Hf(i,a) = 8 a j^fi(Ci). Indeed, /// is a 
probability measure on / x A, 

i,a i,a i 

The measure \x$ has \i as marginal over the a-index, 

Moreover, [if is extremal. Suppose we can write /ij as a convex combination of V\ 
and z/2, two probability measures on I x A with marginal /j., 

1 1 

Substituting the explicit form for [if, one immediately gets [if = V\ = u 2 . Finally, all 
the extremal points are of this form because every probability measure on / x A with 
marginal /i, can be written as a convex combination, 

f 

with Cf > and J2f c f — 1- 

The infimum will thus be reached on this set of measures [if. Moreover, we can restrict 
our attention to injective maps /. This follows again by the concavity of the entropy 
functional. The order of the indices a is of no importance, so we can take as optimal 
decomposition [i a = Si and X a = [i(Ci). As a result, for simple functions fk, 

H CNT [[i, T\ = S{iioT)-Y KCi)S({fik \keK}), 

i 

or, for general fk, 

H™ T [[i, T\ = S{[ioF)- J d[i{x)S{5 x o T) = J d[i(x)S(5 x oF\[ioF). (9) 

Two-times decompositions In contrast with the case N = 1, the optimization 
problem (|7|) is not convex for the case N = 2. To see this, suppose the partitions of 
unity T = {fk \ k G K} and Q = {gi \ I G L} consist of simple functions, fk = J2i fikXCi 
and gi = J2j9jiXD r Here, C = {C{\ and T> = {Dj} are finite partitions of X and so 
isCVV = {C i r\D j }. 

Define now a probability measure on the composed sytem AxBxIxJxKxL, 
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This probability measure has marginals 



/4 = Kfk), 1*1 = K9l)> f*%3 = \<x,/3), 

,,15 _ \(l).M(f \ ,26 _ \(2) „(2)/ \ 
Path - A a A*a U*Ji A^Z ~ A /3 A*/3 15/ J- 

The functional to optimize can then be written as 

S(/i 5 ) + S(/i 6 ) + S(fx 12 ) - S(fi 15 ) - S(fi 26 ). 

The task is now to optimally couple subsystems A and B with 7 and J. If this 
optimization problem were convex, the optimal coupling would identify A with I and 
B with J, as in the case N — 1. This decomposition can yield a negative value for 
the supremum. However, the supremum has to be positive because the functional is 
zero for the trivial decomposition, i.e., = 1 and jf(B) = 1. We conclude that 

this optimization problem is not convex. 

3.2 Hudetz construction 

The CNT construction seems to be intractable because of the supremum over all 
multi-index decompositions of the invariant measure, Eq. (|7|). These multi-index 
decompositions were introduced to obtain finite-dimensional algebras for the one-time 
restrictions. For stochastic systems this algebraic structure is absent anyway. The 
following construction appears to be more natural. 

Definition 3.2 Let (X, fi, O) be a stochastic dynamical system. Define, 

H Hud ifi,F]:= sup I\ji,{\ a fi a },F}. (10) 

The Hudetz (Hud) dynamical entropy of (X,/i, 0) is given by 

/i Hud [/i,6] :=suplimsup^-Jf Hud [/i,^ (JV) [0]]. (11) 

The optimization problem at any time N is now the same as the one encountered in 
the CNT construction for one time decompositon. This supremum was worked out 
explicitly, Eq. |9], 

# Hud [/i, F] = S{n o T) - J dfi(x) S(5 X o T) = J d/j(x)S(5 x oF\^of) (12) 

Moreover, restricting the supremum to partitions of unity JF which correspond to 
sharp measurements, leads to the same result. 

Proposition 3.3 For a stochastic dynamical system (X,fi,Q) holds 

/i Hud [/i,e] = sup hm sup ^# Hu V,x?°[e]]. 

C N^oo iv 
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Proof We have to show that for every partition of unity T = {fk} there exist a 
partition C = {Ci} of X such that, 

^^Wfeia-lMae]]. 

We consider the case N = 2. The proof for other N is analogous. 

Assume that fk are simple functions. The result for general fk will follow by continuity. 
For simple functions fk there exists a partition C = {Ci}i of X such that fk = J2i fikXd 
with M = [fik] a stochastic matrix. Element (k , k\) of the refined partition .F^fB] = 
T V ©(F) is then 

/fc ©(/fci) = ^2 fiakofiikiXC io ®(XC il ) 
ioh 

Thus, 

H o F (2) [9] = (M ® M) * (// o x f [9] ) 
with M g) M a positive unital transformation. By Prop. ^]8|one obtains, 

H^ d [f,,^[e))<H^ d [f,,x { c ] [e)). 

qed 

Referring to the information-theoretic interpretation of {\ a fi a }, J 7 }, the quantity 
H Hnd [fj,, J 7 } can be seen as the mutual information between the initial state and the 
measurement outcomes for the best model of the state space X, namely X itself. 
Therefore, if Hud [/i, T\ equals the information obtained about an initial state x G X 
by performing a measurement fk £ T. The Hudetz dynamical entropy /i Hud [/x, 0] 
equals the average information gain. In this way, out of the three sources of dynamical 
entropy, only the system dynamics contributes. 



Example 3.4 (Deterministic systems) By Prop. \3.!% we can restrict our atten- 
tion to sharp measurements. Recall that deterministic dynamics transform sharp 
measurements into sharp ones. Therefore, all the probability measures 5 X o JF ap- 
pearing in ( [J^ j are pure and if Hud [/i, T\ = S(fi o JF). We conclude that h Uud = h KS 
for deterministic systems. 



Example 3.5 (Finite systems) Consider a dynamical system with a finite state 
space X . Denote the invariant measure by fi = {fi x | x G X}. By Eq. 

tf Hud [/i,F] =£^/ fc (x)l 0g M^ < ]T M:c / fe (x)log- = SQi). 

This quantity is finite and does not depend on N when T is replaced by T^ N > [0] in 
(1771). We conclude that /i Hud = for finite systems. 



Note that the CNT dynamical entropy gives the same results for these two examples. 
Finally, let us compare the Hudetz dynamical entropy with another definition for 
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the dynamical entropy of stochastic systems. It is closely related to [May, but as 
explained before, we use another refinement of partitions, (0) instead of (|1]). First, a 
density matrix is constructed, 



(p Mak [p^]) M ^p(^/hf l ). (13) 
The Makarov dynamical entropy is given by 

h Uak [p, 6] := suphmsup ^S q (p Mak [p, ^[6]]). (14) 

This dynamical entropy leads to the same result as the Hudetz dynamical entropy 
for the two examples discussed. Moreover, it holds that /i Hud < h Mak . Indeed, from 
Lemma [2.9| , 

£(diag(p)) - £ A^diagfo)) < S q (p). 

i 

This is equivalent with H Rnd [p, T\ < S q (p Mak [p, J 7 }) for all partitions of unity T . 



4 AFL dynamical entropy 



In [[AliFanlfl another quantum dynamical entropy was proposed, based on an idea 



of Lindblad, by mapping the evolution of a dynamical system onto a quantum spin 
chain. For the classical stochastical systems we are interested in, the definition is as 
follows. 

Definition 4.1 Let (X, p, 0) be a stochastic dynamical system. Define the density 
matrix p AFL ( N > by 

(p AFL W[//,e,^)_. := ^(/uefyS;. ■■Q{y/fk N .Ji N . 1 ))). (15) 
The AFL dynamical entropy of (X, p, 0) is given by 

h AFL [p,Q] :=suplimsu P 4^(p AFL(7V) ^ ; 0^])- (16) 

T N^oo iv 

Note that the density matrix p AFL (Ar) [p, 0, T\ is different from p Mak [p, .T 7 ^©]] for 
N > 2. For sharp measurements xc with C a partition of X, the density matrix 
p AFL ( N '[p, 0, Xc] is diagonal. In that case, 

s q (p AFL ^{p,e,F]) = s(po^ N )[e}). 

As a consequence, 

h AFL [p,B}> sup limsup^(//oJF( JV )[e]) 

T sharp N—>oo i » 

In fact, equality holds. 
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Proposition 4.2 For a stochastic dynamical system (X,fi,Q) holds 

h AFL [f,, 6] = suplimsup is&i o x?°[e]). 

C Af^oo iv 

Proof We have to show that for every partition of unity T = {fk} there exist a 
partition C = {C{\ of X such that, 

5(/ m ^[ A i,e J ^)< 1 s'( A io X W[e]). 

We consider the case N = 2. The proof for other N is analogous. 

Assume that are simple functions. The result for general /& will follow by continuity. 
For such simple functions, there exists a partition of X, C = {Cj | z G J} and #(/) < 
oo, such that = J2i fikXc r with a stochastic matrix. Component (fc , (^o, ^i) 
of the density matrix p AFL ( 2 ) [//, O, T\ is 



^ ( sj !kjlfi{sj fkifh] 

= A* I JY1 fioko fjohXC H) XC JQ © ( , /XI /j'lii ^C<i ^Cji ) 

= A 4 figkofiQloXCig® ^^/^^ /iifci fiihXC^ ^ 

= ^ (XC <0 © (xc* n ) ) \J fi Q k fi l Q \J fhkJhh 



This a convex combination of #(/) 2 vector states. The coefficient of term (i , ^i) 



is Mxc^XcO) and component (k ,ki) of the corresponding vector is \J fi Q k Q fiikx- 
These vectors are normalized because is stochastic. Applying the second inequal- 
ity in (|) finishes the proof. qed 

Prop. [4.2| leads to the following interpretation of /i AFL [/i, 0]. It is the average uncer- 
tainty on the outcome of sharp measurements. Out of the three sources of dynamical 
entropy, both the system dynamics and the stochasticity contribute. 

Example 4.3 (Deterministic systems) By comparing Eq. [| and Prop. \4-Q , h AFL = 
h KS for deteministic systems. 



Example 4.4 (Finite systems) The dynamical entropy h AFL can be strictly positive 
for finite systems. In this case, the supremum over all sharp partitions is reached 
for the extremal partition, i.e., C = {{x} \ x G X}. For a Bernoulli process with 
probabilities {p x } o,nd J2 x Px — 1 ; one obtains h AFL = J2xV(Px), whereas h Uud = 0. 



Finally, we compare the AFL dynamical entropy with the other definitions. The given 
interpretation and the finite case example suggest the inequality h Und < h AFL . This 
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can be easily proven by Lemma 2.S . Another definition for the dynamical entropy 
of stochastic systems was given in |[Kos et aT| 
systems. In our notation it can be written as, 



based on |[Acc et aT[] for deterministic 



KOW 



suplim sup — S(p, o jF^fO]). 

T N-*oo N 



By comparing this with Prop. |4.2| , h AFL < h KOW . Because unsharp measurements are 
allowed, they can contribute to the dynamical entropy. The three sources of dynamical 
entropy are thus taken into account. As a consequence, h KS < h KOW for deterministic 
systems where strict inequality can hold. Even stronger, without restricting the set 
of allowed measurements, this dynamical entropy will always be infinite. Indeed, the 
partition of unity consisting of k elements rl leads to a dynamical entropy log k. This 
can grow without bounds. 
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